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Abstract 

Abstract: The Standard Model with one extra Higgs doublet may give rise to 
enhanced tree-level flavor-changing-scalar coupling of a neutral Higgs to a pair of top- 
charm quarks. This coupling may drive a large tree-level effective W~^W^ {Z Z) — 
Higgs — tc interaction. As a result we find that the reactions e'^e~ tcVf-Vf,^ tce~^e~ , 
tcZ and the two rare top decays t — > cW~^W~, t cZZ become very sensitive 
probes of such an effective interaction. The most promising ones, e~^e~ tci'ei'e, 
tce~^e~, may yield several hundreds and up to thousands of such events at the Next 
Linear Collider with a center of mass energy of ^/s = 0.5-2 TeV if the mass of the 
lightest neutral Higgs is a few hundred GeV. The rare decays t — > cW^W~ and 
t cZZ may be accessible at the LHC if the mass of the lightest neutral Higgs lies 
in the narrow window 150 GeV < m/j < 200 GeV. 
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1 Introduction 



Understanding the nature of the scalar sector, which still remains one of the great mysteries 
in electroweak theories, and searching for flavor-changing (FC) currents are clearly important 
goals of the next generation of high energy colliders ||l| . 

Although the Standard Model (SM) with only one scalar doublet is in good agreement with 
existing data, it is still useful to examine consequences of simple extensions of the SM. Indeed, 
the simplest possible extension of the scalar potential, which contains two Higgs doublets, 
exhibits rich new phenomena. In particular it may give rise to new tree-level FC couplings of a 
spin particle with fermions ||2|. 

In the SM there are no tree-level flavor-changing-neutral-currents (FCNC). At the one loop 
level, FC transitions involving external up quarks are much more suppressed than those involving 
external down quarks. The effects for the up quarks are driven by virtual exchanges of down 
quarks for which the GIM mechanism is much more effective since the mass splitting between 
the down quarks is a lot less than amongst the charge 2/3 quarks. Therefore, the search for 
large signatures of FCNC involving the up quarks is extremely important as it may serve as a 
unique test of the SM. As is well known, though there are stringent experimental constraints 
against the existence of tree level flavor-changing-scalar (FCS) transitions involving the light 
quarks §, |5|, analogous constraints involving the top quark are essentially non-existent. 

As mentioned above, a mild extension of the SM in which one extra scalar doublet is added, 
allows for large, tree-level FCS interactions @. These are often forbidden by the imposition 
of an ad-hoc symmetry P]; if this symmetry is not imposed, however, one arrives at a version 
of the two-Higgs doublet model (2HDM) wherein the up and down-type quarks are allowed 
simultaneously to couple to more than one scalar doublet ^ leading to tree-level FC vertices. In 
the context of such new interactions, the severe experimental constraints involving FC couplings 
of the light quarks can be satisfied by requiring that FCS interactions are proportional to the 
square root of masses of the fermions participating at the vertex [Q]. A specific realization of 
these ideas, the Cheng-Sher Ansatz (CSA), assumes that the FC coupling of a scalar to top 
and up (charm) quark is proportional to yjmtmu/m\\r (or ^/rn^m^/mw)- In this scenario the 
large top mass makes it much more susceptible to FC transitions. This possibility has led 
various authors to stress the importance of searching for tree-level FCS interactions involving 
the top-quark, especially the top-charm ones [2,5-9]. Our study indicates that experimental 
investigations of the reactions e+ + e~ — > tcve^e] icu^Ve] tce~^e~; tce~^e~; Ztc; Ztc and of the 
rare top decays t — > W^W~c; ZZc will be very useful in this regard. 

The paper is organized as follows: in section 2 we briefly describe the key features of a 
2HDM with tree-level FC couplings, often called Model III. The possibility of producing tc 
pairs via WW and ZZ fusion in the next linear collider (NLC) is investigated in section 3. In 
section 4 we discuss the reaction e^e~ — > Ztc. In section 5 we examine the two rare top decays 
t W~^W~c and t — > ZZc and in section 6 we summarize our results and make some parting 
comments. 
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2 2HDM With Tree-Level FC Couplings (Model III) 

In a most general version of the 2HDM (which ahows tree-level FCS couplings) one can always 
choose a basis of scalar fields where only one doublet acquires a vacuum expectation value 
(VEV) (for a brief review see O): 



i>?) = , {<tp2) = . (1) 



We refer to this type of a 2HDM as Model III. 

With this choice (px corresponds to the usual SM scalar doublet and all the new FC couplings 
are associated with the ^2 doublet. The spectrum of the scalar sector then consists of a charged 
scalar and its conjugate H^, and three neutral Higgs particles which we will denote by h,H 
(the scalar mass eigenstates) and A (the pseudoscalar mass eigenstate) . In terms of the original 
doublets one has: 

H = \/2 (^Rec/)? — cos a + Rec/i^ sin a , 

h = V2 - (Rec/)? - sin a + Rec/*" cos a , (2) 
A = ^/2(-Im(/>^) . 

The masses of the neutral and charged Higgs bosons as well as the mixing angle a are free 
parameters of the model.Q The pseudoscalar A which does not couple to gauge bosons and the 
charged Higgs particles of the model do not play any role in our reactions and therefore their 
masses are not relevant for the present analysis. 

Although with the above basis for Model HI, in which < (j)2 >= at the tree-level, introduc- 
ing large splitting between the masses of the two Higgs particles h and H (in some cases we will 
take niH — rrih > 500 GeV) can become slightly unnatural for large values of a, this is not the 
case in a more general flavor-changing 2HDM where both doublets can acquire a non-vanishing 
VEV. In that more general case, tan/? = V2/V1 appears as an additional free parameter of 
the model. Adopting tan /? 7^ will not affect our predictions in this paper, while, due to the 
presence of this additional free parameter tan /3, large values of a can be accommodated without 
much difficulty in this framework regardless of the degree of splitting between the two Higgs 
masses. Note also that tan/3 will not enter the FC couplings of a neutral Higgs to fermions as 
those are governed by the couplings Xij to be defined below. We therefore wish to emphasize 
that we are not trying to advocate the existence of the above particularly simple realization of a 
FC 2HDM where one of the Higgs doublets does not acquire a VEV, instead, for its simplicity, 
we are using it as an illustrative scenario to estimate the size of a possible FC effect in our 
reactions. Thus, in what follows, we will always choose the mass of the lighter Higgs, h, to be 
in the range 50 GeV < ruh < 1 TeV while, in most instances, we will set the heavy Higgs (H) 



We use a instead of a to avoid confusion with the fine-structure constant. 
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mass to be niH = 1 TeV independent of the choice of mixing ang le d.0 
The FC part of the Yukawa Lagrangian in Model III is given by [Q, 

= iYjQi,L4^2Uj,R + if,Qi,L<t^2Dj,R + h.c. , (3) 

where (j)2 denotes the second scalar doublet, 02 = «T202 5 Q stands for the quark doublets, and 
U and D for charge 2/3 and (-1/3) quarks singlets; i,j = 1,2,3 are the generation indices and 
^ are 3x3 matrices parameterizing the strength of FC neutral scalar vertices. Following Cheng 
and Sher M we choose the parameterization: 



^,D^g^V^^ (4) 

In this scenario all our ignorance regarding the FCS vertices is contained in the couplings Xij 
which are free parameters to be deduced from experiments. The experimental constraints on 
the Xij are rather mild: for example, if \sd,\d and Xuc are kept below ~ 0.1, then Model III 
is compatible with the existing low energy experimental measurements as long as the other FC 
couplings (i.e., those involving the top quark) are not much larger than 1 [||]. In particular, if 
the first generation FC couplings are not related to the FC couplings of the second and third 
generations (there is no good reason to believe that such a relation exists) then Ate = Act ~ 
0(1), or even somewhat bigger, is not ruled out^ by existing experiments [^. This has major 
consequences on our analysis in this paper as all the reactions investigated here scale like X^^.. 

For simplicity, we choose Xtc = Act = A and we furthermore break A into its real and 
imaginary parts, X = Xr + iXj. Then, within the CSA, the relevant terms of the Model III 
Lagrangian become: 



L-Htc = 7=- JHrityXR + iXa^)c , (5) 

V2 mw 

J^HVV = -gwmwCvcnHg^yV^'V'' , (6) 

where here and throughout the paper n = hoi H andV = W ov Z andQ: 

fh;H = COS d; sin d , (7) 
Ch-ff = sind; — cosd, (8) 
Cw-z = '^\m\lmw ■ (9) 

^Note that the onset of a strongly interacting Higgs sector corresponds to the breakdown of tree- level unitarity and 
also to the condition that the radiative corrections to the Higgs mass are of order 100%, i.e., Smn ~ rriH- Much like 
in the SM case, this will occur when ijih ~ 47rw 3 TeV. Therefore, although taking mn — 1 TeV is somewhat close 
to the above limit, still, it is unlikely to enter the strongly interacting Higgs domain. 

'^Xtu is also not well constrained from existing experiments. The Cheng and Sher Ansatz does, of course, imply 
much smaller tu coupling compared to the tc one due to the up-charm mass difference. 

*V = W~^,W~ or Z; in most instances the appropriate choice can be fixed by inspection. If necessary we will 
denote =W+,V^ = W- or V^ = V^ = Z. 
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The amplitude for the reaction VV — TC — tc, ic is proportional to sin 2d for both TC = h and 
H, and will vanish for a = 0,7r/2. When a = tt/A (i.e., equal mixing between Re05 — Re(/)2) 
the h and H contributions interfere destructively and cancel out in the limit mn — > ruh- The 
presence of this "GIM-like" cancellation reflects the fact that all complete calculations should 
include both neutral scalars. The maximum of the cross section is not reached at d = 7r/4 since 
the scalar widths also depend on this parameter. 

We will also need the Titt couplings within Model III: 

jOntt = -^-^'Hi{an + ibni5)t , (10) 
V2 mw 



where 



Qh = 1= sin Q + cos q.Xr , bh = cos dXj , (11) 

v2 

an = —/= cos a + sin oXr , bn = sin aXj , (12) 
v2 



and for simplicity we set Xu = Xtc = X. 



3 tc Production Through Vector-Boson Fusion 

In this section we consider the reactions (see Fig. 1): 

e~^e~ tcuei^e'-, icVeVe , e~ -^tce~^e~; ice^e~ , (13) 

occurring via W'^W^ or ZZ fusion, which should be accessible to the Next generation of e^-e~ 
Linear Colliders (NLC) currently being envisaged We will see that these processes are very 
sensitive to FC currents ||lO|] . 

An extremely interesting feature of the reactions in (|l^) is that at cm. energies of TeV 
and above, the corresponding cross-sections can be much larger than the ones for the simple 
s-channel reactions in Model III: e+e" — > tc (see ^) and e+e" — > HA — > tc//; ttcc (see p). 
For example, we find that a^"*^ = a{e'^e~ — > tcue^e -\-ici'e^e) is about two orders of magnitude 
larger than a{e'^e~ — > tc + ic) over a large region of parameter space, while a^^^^ = a{e~^e~ 
tce^e~ + tce+e~) is about one order of magnitude bigger than a{e^e~ tc + ic). The crucial 
difference (and therefore interesting) feature of the VV fusion reactions is that, being a t-channel 
fusion process, the corresponding cross-sections grow with the cm. energy of the collider. On 
the other hand, the "simple" s-channel reactions mentioned above drop like 1/s. Thus, even if 
no tc events are detected at ^/s = 500 GeV via e~^e~ — > tc; tcff; ttcc, there is still a strong 
motivation to look for a signature of (|l^ ) especially at somewhat higher energies. 

In exploring the reactions e~^e~ — > tcVgUg, tce'^e~ we will use the effective vector boson ap- 
proximation (EVBA) |jll| . Recall that this is the analog of the equivalent photon approximation 
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in QED which allows the colliding VF's or Z's to be treated as on-shell particles. The salient 
features of the reactions in (|13|) are then well approximated by the simpler fusion reactions: 

W+W~,ZZ ^tc,tc . (14) 

The corresponding cross sections for the reactions in (|l3|) can then be calculated by folding in 
the distribution functions for a vector boson V {W or Z) with helicity hy. 

The EVBA has been extensively studied in the production of a pair [12|. There is, however, 



a significant difference between fusion reactions leading to a tc final state, due primarily to the 
appreciable difference in the threshold of the two-reactions (which, in turn, is due to nit ^ ^c)- 
This has two consequences: 

1. For tc the vector-boson energy fraction, x = \/s/s (as usual s is the cm. energy squared 
in the VV cm. frame and s the corresponding quantity in the e~^e~ cm. frame), can drop 
below X = 0.05 near threshold, for ^/s > 800 GeV. In this small-x range the distribution 
functions are overestimated within the leading log approximation |12, We will therefore 



use the distribution functions which retain higher orders in rriy/s, as given, for example, 
by Johnson et. al. [p^ ]. 

2. For large the longitudinal polarization vector of V can be approximated by eQ{k) ~ 
k^/mv + 0{mv /\^)- In the production of a pair of heavy fermions (such as ti) through 
VV fusion, the term /my gives rise to a contribution proportional to {mt/my)'^ in 
the cross section; the subleading contributions, generated by the 0{my / ^J1,) remainder 
in eg (A:), are suppressed by a factor of ~ m^js. Thus d{VV tt) is well approximated 
by taking only the longitudinal polarized V^s at the parton level reaction and assuming 
that s S> rriy [12, 13|. In contrast, the approximation eg(/c) ~ k^ /my does not necessarily 



hold for the reaction VV — > tc for which my/s ~ my/m^ near threshold. In particular, 
we will show below that the cross-section for the reaction VV TC ^ tc scales like 
l^Xyi '^y"^ ' -"^^^ only is the {mt/my)'^ factor absent, but the contribution from the 

transversely polarized V's is comparable to that of the longitudinal V^s near threshold. 
We will therefore include all polarizations for the vector bosons in our calculation of 
a{VV -^n^tc). 

It is interesting to note that while at tree-level, o"^^**^ = in the SM, the parton level reaction 
W~^W~ — > tc can proceed at tree-level, via diagram a in Fig. 1. Note that the corresponding 
cross section is proportional to {mt/mv/)'^ to leading order, and the usual replacement eQ{k) 
k^ /my/ is appropriate. For collision of longitudinal Ws, W^WJ^ — > tc, within the SM, we 
obtain: 



where i,j are family indices, sy/ = sin^iy and A'^c = 3 is the color factor. Aj = mf/s and I^j 
are the two body phase-space integrals: 
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~ ' ^ {x - m^.)(x -rn?^^ ' ^^^^ 



In (|T^) we have set = , however the three down quarks masses must be kept non-zero as 
the unitarity of the Cabibbo-Kobayashi-Maskawa (CKM) matrix impUes that (Tsm = when 
rrid = TTT-s = rrih (in particular, when nid = rUs = rrib = 0). Numericahy, itsm is found to 
be too small to be of experimental relevance as it suffers from a severe CKM suppression: 
a^'^" = asM(e+e- ^ tcUeUe + icUeUe) « 10-5 - 10^'' (fb) for ^ = 0.5 - 2 TeV. We will hence 
forward neglect the SM contribution. 

This is, therefore, a remarkable situation which allows for a unique test of the SM and, in 
particular of the SM's GIM mechanism. Even a very small number of tcV(,i>(. and/or tce^e~ 
detected at a NLC running with a yearly integrated luminosity of £ > 10^ [ft>]^^ Qj will 
unmistakably indicate new FC dynamics beyond the SM. In Model III event numbers in the 
range of a few x (10^ — 10^) for tcV(,i>(,^ and a few x (10^ — 10^) for tce^e~ are easily possible 
within the existing experimental constraints. 

For Model III, W tc proceeds at tree-level via the s-channel neutral Higgs exchange of 
diagram b in Fig. 1. Neglecting the SM diagram, the corresponding parton- level cross-section 

= HVi^^V^^, ^ tc) is given by 

^ = (sm2a)^W (ilHL)%f • | ^ |n^ - n^,| ^ X 

mtr?T,c^a+a_(a+Afj + a_A|) , (17) 

where: 



a± = s - {mt ± rric) , /S^ = y 1 - 4mf /s , (18) 

and: 

nw = 7-^ 2-^. TTT • (19) 



m. 



Given the couplings of Model III, T-j-i (the width of 7i) can be readily calculated . The leading 
decay rates in this model are 7i — > bb,tt, ZZ,W'^W~ and tc,ct. When kinematically allowed, 
we include all these contributions in calculating the above cross-sections. For definiteness, we 
will present our numerical results for d = 7r/4.|^ We will also ignore CP violation and take 
A/ = and A = Xr. In calculating the cross sections we first vary the mass of the lighter scalar 
h in the range 100 GeV < ruh < 1 TeV, while holding fixed the mass of the heavy scalar H at 
niH = 1 TeV. We will later discuss the case ruh ~ mn- 



^As will be shown later, the VV fusion cross-sections in (^) reach their maxima at a ~ tt/6 which is larger by a 
factor of ~ 1.5 than their value at a = 7r/4; as indicated previously the cross sections vanish when a — 0, tt/2. 
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Due to the orthogonality properties of the and V'^ polarization vectors, there is no 
interference between the transverse and the longitudinal polarizations. Note that -e^ p = 0, 
\e^^ ■ e^^l"^ = 1, and \eQ^ ■ Cq'^P = (1 + — /3y)^ which grows with s. However, we 

can see from (0), that (Ty(m^/s — > 0) ^ ensuring unitarity of the hard cross-section. 
In general, the transverse distribution functions are bigger than the longitudinal ones for x 



> 0.1 [12, 13 1 . Therefore, the relative smallness of the transverse hard cross-section compared 
to the longitudinal one is partly compensated for in the full cross-section. In particular, we find 
that the contribution from the transversely polarized PF's(Z's) constitutes up to 25% (35%) of 
the corresponding total cross-section a^'^^'^^a^'^^'^). 

It is evident from ( p^ that aw az for myi/ — > mz- The main difference between cr^''*'^ and 
^eetc ^j-^gjj arises from the dissimilarity between the distribution functions for W and Z bosons. 
In particular, disregarding the subleading transverse parts of the WW and the ZZ cross-sections, 
the relative strength between the W and the Z longitudinal distribution functions is given by 



f^ = ^(2s^w-s'w + -Af^^y^ ■ (20) 



1 

3- 

Therefore, since the dominant contributions to the cross-sections a^'^^^ and a'^'^^'^ are produced 
by longitudinal VF's and Z's, a^^^'^ is expected to be smaller by about one order of magnitude 
than a'^'^^^, which is indeed what we find. We will thus only present numerical results for 
(jf^tc^ keeping in mind that o"'^'^*^ exhibits the same behavior though suppressed by an order of 
magnitude. 

Fig. 2 shows the dependence of the scaled cross-section g^^^'^ j}? on the mass of the light 
Higgs m,h for four values of s.| The cross-section peaks at rrih ^ 250 GeV and drops as the 
mass of the light Higgs approaches that of the heavy Higgs due to the "GIM-like" cancellation 
present in the scalar sector (which is only partly effective when a ^ '7r/4). Nonetheless, as will 
be shown below, o^"^'^ j}? can stay at the fb level even for m/j = ran. When = 2 TeV the 
cross-section is about 5 fb for A = 1 and rrih ~ 250 GeV.0 It is therefore evident from Fig. 2 
that at an NLC running at energies of \fs > 1 TeV and an integrated luminosity of the order of 
£ > 10^ [fb]^^i Model III (with A = 1) predicts hundreds and up to thousands of tcVfJ)^ events 
and several tens to hundreds of tce^e~ events. For example, with t/s = 1.5 TeV, L = 500 
[fb]-i H, and ruh ^ 250 GeV, A = 1, the cross-section a""^" {a''''^'') would yield about 2000(200) 
such events. Note also that even with m/j ~ 500 GeV, this projected luminosity will still yield 
hundreds of tcvei^e events and tens of tce^e~ events at ^/s = 1.5 TeV. The corresponding SM 
prediction yields, as shown above, essentially zero events. 

The choice a = 7r/4 is special in the sense that for this value the GIM-like cancellation 
mentioned above is most effective, however, it does not correspond to the maximum of the 
production rates. In Fig. 3 we show the dependence of a'^'^^'^/X'^ on (sina)^ for m/j = 250 



^The scaled cross-section, cr'"'*'^/A^, has a residual mild dependence on A through its dependence on Th- 
''The cross-section is (x A^ so that even a moderate change of A, say by a factor of three, can increase or decrease 
the cross-section by one order of magnitude. 
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GeV, yfs = 1 TeV and for two possible values of mn, rnn = 250 GeV and uih = 1 TeV. 
The same behavior is observed for any value of s in the range 0.5-2 TeV. We see that for 
niH = 1 TeV, which represents the case of large splitting between the two neutral Higgs particles, 
a'^'^^TT/U < a < 7r/4) > a'^'^^d = tt/A). Moreover, even for {mn - ruh) « 0, a'"^*^ > 1 fb 
is still possible for 0.02 < (sin a f < 0.22 and 0.78 < (sind)^ < 0.98. In fact, our analysis 
shows that, with moderate restrictions on d, a'^'^^'^ remains well above the fb level for ^/s > 1 
TeV as long as one of the neutral Higgs particles is kept within 200 GeV < m-H < 400 GeV, 
while the mass of the other Higgs can take practically any value between 100 GeV - 1000 GeV. 
Moreover, note that as d drops below vr/G the cross-section becomes less sensitive to the heavy 
Higgs mass. For example, we find that with d « 7r/27 (which may represent the case of a small 
d) and for ^/s = 1 TeV, a'^'^^'^ « 1 fb regardless of the heavy Higgs mass (i.e., mn = 250 — 1000 
GeV) and as one goes to ^/s > 1 TeV, a'^'^^^ becomes even bigger. It is therefore clear that the 
FC effect being investigated in this section remains very interesting within a large portion of 
the free parameter space of the Higgs sector in Model III. 

Before ending this section we wish to comment further on the comparison between the 
cross-section a{e~^e~ — > tc) discussed in Q and the WW annihilation cross-section a'^'^^'^ within 
Model III. To do so, for convenience, we normalize the cross sections to the cross-section: 

ryuutc _ ^(e+e" tcUeUe + tCZ^ei^e) pfe _ (rje+e' tc + tc) 

(j(e+e ^ 7 ^ n+ ^ ) c7(e+e ^ 7 ^ ) 

Note that while Ey'^^^ scales as A'^, i?*^ is proportional to A^. It was shown in |p that R^^/X^ 
can reach 10~^ for a light Higgs mass around 200 GeV and cm. energy of ^/s = 500 GeV. As 
the cm. energy is increased -R*^/A^ stays fixed at the 10~^ level due to the ~ 1/s behavior of 
a{e'^e~ tc + ic) with one loop FC Higgs exchanges. 

In Figs. 4 and 5 we have plotted W^^'^ j}? as a function of rrih and y^, respectively. We 
see that for ~ 250 GeV and a cm. energy of = 500 GeV R'^^^'^ j}? peaks at around 
10~^, two orders of magnitude above R^^ /X^. We therefore expect the number of tcV(.v^ events 
in the NLC to be bigger by about two orders of magnitude than the number of tc events. 
Moreover, while the cross-section for producing a pair of tc sharply drops as ^fs is increased, 
the WW fusion cross-section, a^^^'^ grows with s. In particular, Figs. 4 and 5 show that for 
200 GeV <mh< 400 GeV, i^^'^^VA^ ~ 10"^ for ^ ~ 1 TeV and R"""^"!}? ~ 10"^ for ~ 2 
TeV. 

4 e^e~ tcVeVe vs. e^e~ ttvjjf. and Background 
Considerations 

In order to give the reader a qualitative feel for the effectiveness of the tcUgiJe production rate it is 
instructive to compare it, in Model HI, to the production rate of the "normal" e~^e~ — > ttfe^e- 
We recall that cr'^'^** = a{e^e~ W~^W~i^e'^e tivf^v^) is dominated by collisions of two 
longitudinal W^s at the parton level jl^. The reaction VF+VF" — > ti can proceed through 
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the f-channel b quark exchange and the s-channel 7, Z, h and H exchanges (the diagrammatic 



description can be found in [12, [T5[|). 

The hehcity amphtudes Ar^=fi, Arj=-fi (v and fj denote the hehcities of the t and t quarks, 
respectively) for W^W£ tt, including all the contributing diagrams, are given by: 



A.. 



v=-v 



vra mjA 



2-Ka rrif 



t - 2/3t cos e 



H=h,H 



1 + Pi -2l3tcose 



sin( 



(22) 



(23) 



where 6 is the cm. scattering angle and a-j-^, b-j-^ and cn are given in (|ll|) , (|12|) and (|8D. In the 
SM limit a = —it /A and A/j, A/ = 0, the hard cross-section for W^W£ tt, obtained from (22) 
and (p3| ) agrees with the one obtained by Eboli et. al. in 

We give below only the "non-standard" parts ^hh:^HH,^hH,^bh and (7;,ii/:| 



O'ER 



gt{smaf\Uh\^[p?al + bl] 
GticosaflUnf [p^ajj 
-Qt sin 2aRe(n/in^) {j5'jahaH + bhbn) , 



^bh = Gtsind ahil - Ah)\Ilh 



2^2 



(1 - Pt) 



<7bH 



-Gtcosa anil - Ah)\IIh\ 



2/3t 



" A-(l+A 

A-(l+A 



(24) 
(25) 
(26) 

(27) 
(28) 



where atj, i ^ j denotes the interference cross-section of the i and j intermediate states, and: 

'A + 1 



—Pt 



A = ln 



w 



1 



(29) 



In Fig. 6 we plot the ratio i?*^/" = a""^"" / a''''*^ within Model III for A = ij^ d = 7r/4 and 
niH = 1 TeV as a function of the light Higgs mass ruh and for y/s = 0.5, 1, 1.5, 2 TeV. a'^'^^^ 
depends very weakly on m/j, with a small peak at m/j ~ 400 GeV which fades as y/s grows. 
Therefore, R^^/^^ peaks with a'^'^^^ at mf^ ~ 250 GeV. We can see from Fig. 6 that for = 0.5 
TeV and in the range 200 GeV < m/, < 400 GeV, i?*^/" > 1. In particular, for ruh ~ 250 GeV, 
(j'^'^^'^ can become almost two orders of magnitude larger than a'^'^^^. As y/s grows, i?*'^/** drops. 
In the range 200 GeV < mt < 400 GeV, we find that for ^ = 1 TeV, i?*^/" > 0.1, while for 

= 1.5 - 2 TeV, 0.01 < i?*^/" < 0.1. 



^The SM-like parts can be extracted from the paper by Eboli et. al. in |12[ by changing the appropriate quantum 
numbers of the final state fermions. 

^Recall that we have assumed for simplicity that Att — Xtc — A. 
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The dependence of cr'^'^** on A is significant only near its peak (at ruh ~ 400 GeV); for 
200 GeV < ruh < 400 GeV, where i^'^^/** acquires its largest values, i^'^^A* roughly scales as A^. 
Thus, again a mild change in A, can alter i?*'^/** appreciably. Hence, within Model III, with ruh 
in the few-hundred GeV range, it is possible to observe comparable production rates for the 
tcVf,D(. and tiV(.D(. even at a NLC running at a TeV range cm. energies. 

We have not done any serious study on the issue of backgrounds. For example, i/ei>eW~^W~ 
is expected to be about an order of magnitude bigger than Ue^eti and therefore could be of 
concern. However, we remark that the NLC literature suggests that detection of t (or t) via 
the main mode t bqq' (i.e., 3-jet events) with the constraint mjeti + rnjet2 = mw can be 
achieved with a relatively high efficiency [^]. The uvWW cross-section also has distinctive 
constraints on it that, along with the rather clean t detection, are expected to be very effective 
in separating it from uvtt or uvtc final states. In the case of the Vei'eic final state, in addition to 
the top-quark detection via, for example, the 3-jet mode, the other (charm) jet is rather unique 
and should stand out as essentially a light quark jet, i.e., the event should look like a single top 
quark event. Therefore, it will be difficult to fake a tc event with a ti or WW event. 



5 The Reaction //' ^ Vtc 

In this section we explore the possibility of observing a signature of a Ztc final state (and 
its conjugate one) at the NLC. Within Model HI, the reaction //' — > Vtc {V = Z,W~^ or 
W~ depending on the quantum numbers of the //' initial state) proceeds at tree-level via the 
Feynman diagram depicted in Fig. 7. Of course, disregarding the incoming //' fermions, this 
reaction is directly related to the sub-process VV TC ^ tc. We can therefore express the 
cross-section ct(//' — > Vtc) in terms of the hard cross-section ay given in (^): 



a(ff> ^ Vtc) 



a 



67r(sin 2(9h/)2 



JiV) 



+ a 



fiv)]- 

R \ 



dz L0iU)2 



Ji + 12Cf 



E 



(30) 



h,,i,h 



v2 



Here Ai = rnj/s {s being the cm. energy of the colliding //' fermions) and Hy = (1 — 
Also Q = mi/mt and uJi, uj2 are function of z given by: 



uji = (l - (^A^ + v^)) (l - (Ta^ - v^)) , 
u;2 = zJl-Az~^Cl , 



(31) 
(32) 



and we have defined the V f f interaction lagrangian as: 



^W-T^W(ar^ + ar^)/> (33) 
cw ^ ' 
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where L{R) = (l=F75)/2. 

The formula given in ( pO| ) is general and can be applied, for example, for calculating the sub- 
process cross-sections uu, dd — > Ztc and ud] ud — > W~^tc; W~tc relevant for hadron colliders. 
Here we wish to concentrate only on the cross-section o"^*^ = cr(e"'"e~ Ztc + Ztc) relevant 
for the NLC and for which V = Z, f = e~, /' = e+ and a^*-^^ = 1/2 — Syy, ctj^^ = s\^. 
The production of a real Higgs boson and a Z boson via c^c~ — > Z — > ZJi followed by the H. 
decay Ti ^ tc was investigated in . This is of relevance whenever there is sufficient energy to 
produce a real ZTL pair and mj^ > mt + rric, then: 

(j(e+e~ Zn^ Ztc + Ztc) ^ a{e~^e~ -> Z ^ ZU) x Br ^ tc + tc) . (34) 

Here we will extend the analysis performed in by including both neutral Higgs particles, 
produced either as real or virtual particles. 

In Fig. 8 we plot (T^*'^/A^ as a function of the light Higgs mass, m/i, for various values of -y/s, 
and in Fig. 9, cr^'^^/A^ as a function of s for various values of m/j (ran = 1 and a = 7r/4 are kept 
fixed). We see that there is a significant difference between o"^*'^ and cr'^'^*'^, cr^'^*'^; the former 
drops with s (as expected for an s-channel process) while the latter increase with s. Therefore, 
a search for a Ztc signature will be most effective at lower energies. In particular, we find that 
^ztc jy2 pgg^j^g when the cm. energy is a few tens of GeV above the threshold for producing a 
real hZ pair. At ^ = 500 GeV and for 200 GeV < m,, < 350 GeV, cr^^VA^ > 0.2 fb and peaks 
for rfih ~ 250 GeV at ~ 0.6 fb. In this range h is produced on-shell and then decays to tc. 

Apart from the overall factor of (sin2a)^ in the cross-section (from the W TL ^ tc 
matrix element), there is an additional strong dependence on a coming from Br(/i tc + tc). 
This quantity also generates a strong suppression (for a = 7r/4, Br(/i — > + ic) ~ 10^^) since 
h decays mainly into W pairs: Br(/i W~^W~) ~ 1 for a = 7r/4 and 2mt > mh > 2mw 
and Br(/i W^W^) ~ 0.7 ^ Br(/i tt) when nih > 2mt. In contrast, within the SM 
Br(/i W+W-) ~ Br{h ^ if) ~ 0.5 for ruh > 2mt. 

Similar to the VV fusion case, when there is large splitting between the masses of the two 
neutral scalars (i.e., rriH = 1 TeV), a^*^/\^ is maximized for a ~ vr/G. In Fig. 10 we plot 
f7^*7A2 as a function of (sina)^ for ^ = 500 GeV, mu = 250 GeV and niu = 250, 1000 GeV.|3 
As can be seen by comparing Fig. 3 with Fig. 10, ct^*'^ and a"''*'' exhibit the same dependence 
on a since both reactions are governed by the VV — TC — tc amplitude; we again find that for 
mH = l TeV, cT^*^(7r/14 < d < 7r/4) > a^^^d = tt/A). When mn ^ mn ^ 250 GeV, a^^" > 0.2 
fb is still possible for 0.02 < (sinQ;)^ < 0.28 and 0.75 < (sind)^ < 0.98. 

We thus conclude that at an NLC running at y/s = 500 GeV and a yearly integrated 
luminosity of £ ^ 10^ [ft>]^^ we can expect several tens and up to hundred such Ztc raw 
events for 200 GeV < rrih < 350 GeV (the number depends on d but is insensitive to mn)- 
However, unlike the i/i^tc and the eetc signals which form a relatively clean signature (especially 
at higher energies, i.e. ^/s > 1 TeV, where there is practically no competing process that can 
produce a pair of tc), the Ztc final state may suffer from severe background problems if scalar 
FC interactions are indeed present. For example, assuming that a tc pair can be detected with 

Here also, the same behavior as a function of (sina)^ occurs for higher energies. 



12 



some efficiency factor, still, the production rate of a pair of TCA via e^e^ ^ Z — > TCA followed 
by the decays A ^ tc and — > // (recall that TC = h or H and / stands for a fermion) may 
well overwhelm that of e~^e~ ^ Z — > Ztc. 



6 The Rare Top Decays t W^W-q, t ZZc 

Finally we wish to discuss the two rare decays t — > W~^W~c and t ZZc. The latter being 
possible only if mt > 2mz + rUc (which is still allowed by the data) . Within the SM these decay 
channels are vanishingly small. For the first one, t — > W~^W~c, even though a tree-level decay 
in the SM (i.e., the tree-level diagram is the same as the one depicted in Fig. la without the 
electron-neutrino fermionic lines), suffers from the same severe CKM suppression which appears 
in the subprocess W~^W~ — > tc considered before. Typically, one finds Br(t — > l^"'"VF~c) 



10-^3 _ 10-12 for 160 GeV < mt < 200 GeV 0, |T8|. For the second decay t ZZc, the 
branching ratio is even smaller since it occurs only at one loop and in addition it is also GIM 
suppressed. 

The situation is completely different in Model III where both decay modes can occur at the 
tree-level through the FC Higgs exchange of Fig. lb (without the leptonic lines) and the CKM 
factors are absent. These decays are thus related to the fusion reactions, WW, ZZ — > ic, by 
crossing symmetry. Therefore, in terms of the hard cross-section given in (p 



Tvv ^ nt - VVc) = z{z - ACDY: ^y\s=^lz ■ (35) 

The scaled branching-ratio Br(t W^W~ c) j}? is given in Fig. 11 as a function of the light 
Higgs mass and for mt = 170, 180 and 190 GeV. Also, in Table 1 we present the branching-ratios 
for both t W^W~c and t ZZc where we focus on the range mt — 25 GeV < mh < mj + 25 
GeV (keeping mh > 2mw)- We see that Br(t — > W'^W~c)/X'^ is largest for 2mw ^ mh < mt 
and drops rapidly when mh < 2mw or mh > 200 GeV. The reason is that when mh < 2mw 
or mh > mt, the decay t W+W- is a genuine 3-body decay. Thus, it suffers a suppression 
factor ~ Br(t W^W~ c) /Jiv{t he) compared to the essentially 2-body case, t he, which 
is relevant for the window, 2mw ^ mh < mt- Br(t W~^W~c)/ X"^ is typically a few times 
10~^ for mh > mt and can reach ~ 10~^ in the mh < 2mw region. For a wide range of mh, i.e. 
from about 50 GeV to about 300 GeV, Br(t — > W^W^c)/ X'^ is 3-4 orders of magnitude larger 
than the SM prediction. 

For optimal values of mh, lying in the very narrow window, 2m vk < mh < mt, we find 
that Br(t — > W^W~c)/ X'^ can reach the 10~^-10~^ level. In this region the t-quark decays to 
an on-shell Higgs boson followed by the decay h W'^W^. Note that the process t ^ ch 
studied in Q is related to the reaction t — > W~^W~c under discussion here. In the region 
2mw ^ mh < mt the decay width satisfies Tww ~ ^{t ch) x Br(/i W~^W~). Note, 
however, that the analytical results of ||^] correspond to the choice d — > and in this special 
case Higgs decays to WW, ZZ are suppressed at tree level even when mh > 2mw- In the 
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present paper we use the more generic value a = tt/A in which case h — > WW becomes the 
dominant h decay. 

Concerning t — ZZc, the branching ratio is typically ~ 10~^ for 2mz + mc < mt < 200 GeV 
if again niii lies in the very narrow window 2mz < ruh < rrit- Also, both decays are very sensitive 
to mt. In Fig. 12 we have plotted Br(t ^ W+W-c)/X'^ and Br(t ZZc)/X'^ function of 
mt holding fixed the mass of the heavy Higgs boson at mH = 1 TeV and taking mh = 170 and 
185 GeV. We see that a ~ 10 GeV shift in mt can easily generate an order of magnitude change 
in the branching ratios. For some possible values of mh in the range 150 GeV < m^ < 200 GeV 
it can even generate a change of several orders of magnitude. 

7 Summary and outlook 

In this paper, we have emphasized the importance of searching for the FC reactions e'^e" 
tcUeVe, e^e~ — >■ tce~^e~ and e^e~ Ztc in a high energy e^e~ collider. These reactions are 
very sensitive indicators of physics beyond the SM with new FC couplings of the top quark. As 
an illustrative example we have considered the consequences of extending the scalar sector of 
the SM with a second scalar doublet such that new FC couplings occur at the tree-level. At 
y/s = 500 GeV the production rates for the Ztc and tcugt'e final states are comparable (several 
tens of raw events are expected). However, for cm. energies at the TeV level and above, we 
found that within a large portion of the parameter space of the FC 2HDM, i.e. Model III, in a 
one year of running with a yearly integrated luminosity of C > 100-500 [fb]~^, these new FC 
couplings may give rise to several hundreds and up to a few thousands tcfePg events and tens to 
hundreds of tce~^e~ events in the NLC. This will unambiguously indicate the existence of new 
physics. 

We have shown that the comparison between a"'^*'^ and the "normal" a'^"^* comes out fa- 
vorable in these models. The tc final state involved, is rather distinctive and, therefore, serious 
background problems for either the tci'e'^e or the tce^e~ signatures are not anticipated. More- 
over, from the experimental point of view, it should be emphasized that although a^^*'^ is found 
to be one order of magnitude smaller then a'^^^'^, the tce'^e~ signature may be easier to detect as 
it does not have the missing energy associated with the two neutrinos in the tcuei'e final state. 
Also, at y/s > 1 TeV, the tcvjjf. and tce^ e~ signatures arc to some extent unique, as other simple 
FC s-channel processes like Z ^ tc, e^e^ ZTC Ztc and e^e^ AH ttcc, tcff 

tend to drop as 1/s and are therefore expected to yield much smaller production rates at an 
e^e~ collider with ^/s > 1 TeV. 

We have also examined the two rare top decays t W'^W'c and t ZZc. We found that, 
within Model III, the branching ratios are many orders of magnitudes bigger then the SM ones. 
However, detection of such exotic signatures may not be possible at the NLC as it is expected 
to produce ~ few x 10^ tt pairs. However, if nature provides us with a scalar particle, /i, with 
mass in the range 150 GeV < m^ < 200 GeV and with FC couplings to tc, then the LHC, which 
will be capable of producing 10^ — 10® tt pairs, will be able to detect those rare signatures of 
top decays. 
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We wish to end with the following remarks and outlook: 

• Note that in our previous work, ||l^, we have used uih = 750 GeV while here we have 
set the heavy Higgs mass to be nin = 1 TeV. No significant difference between the two 
choices is observed. 

• It is most likely that the Higgs particles, if at all present, will have been discovered by the 
time the NLC starts its first run. If indeed such a particle is detected with a mass of a few 
hundreds GeV, it will be extremely important to investigate the reactions e^e~ — > tcvei>e 
and e^e~ — > tce~^e~ in the NLC as they may serve as strong evidence for the existence 
of a nonminimal scalar sector with FC scalar couplings to fermions. In addition, since 
supersymmetry strongly disfavors an h heavier than ~ 150 GeV, the detection of a Higgs 
particle above this limit would drive the study of general extended scalar sector, not of a 
supersymmetric origin, and, in turn, this should encourage the study of FC effects such as 
the ones studied in this paper. 

• The large FC effects in e~^e~ — > tci'e'^e and e~^e~ — > tce^e" described above may serve 
as a "yardstick" for other, possibly large, FC effects in those same reactions. In this 
sense, a model independent analysis of the reactions e'^e~ — > tcve^^e and e+e~ — > tce^e~ 
can be very useful. This can proceed by either incorporating explicit phenomenological 
FC vertices of Ztc,WWtc, Z Ztc etc., or by considering new effective couplings (possibly 
right-handed) of the W boson to the top and a down-type quark which will affect Fig. la 
p^ . Note that the effects of an effective Ztc coupling, if at all measurable, will be directly 
probed in the reaction e^e~ — > Z tc whose cross section is larger by a factor of 
~ (a/vr)^ (a being the fine structure constant) than the one for tcvgi^e through WW 
fusion. Therefore, if a vanishing production rate for e^e~ Z ^ tc is measured in a 
NLC with a cm. energy around ^/s = 500 GeV, then the possibility of a significant Ztc 
coupling will be basically eliminated. 

• The cross-sections for e~^e~ — > tcve^^e and e"'"e~ tce~^e~ grow with the cm. energy of 
the colliding fermions. Therefore, an analogous study, for the LHC, of production of tc 
pairs via VV fusion may be even more interesting. However, note that in the LHC, these 
type of reactions are likely to suffer from much worse background problems. 

We will refer to some of these points in a later work. 
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Note Added. After completion of this manuscript, which is an extension of our previous 



work |1C], we became aware of a very recent work | |2C1[ | where (among other things) an exact 
calculation for the reaction e'^e" — > tcVf.V(. is reported. The difference with the effective vector 
boson approximation used here appears to be at the order of 10% in the range 200 GeV < 
mh < 400 GeV and 1 TeV < y/s < 2 TeV. For mn > 400 GeV and 1 TeV < ^/s < 2 TeV the 
difference can be at the order of 30% or so. In general the difference diminishes as y/s decreases. 
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Table 1: The scaled branching ratios Br{t W+W-c)/X'^ and Br(t ZZc)/\^ in units of lO^^ 
for rriH = 1 TeV, a — ir/A and for various values of rrit and nih- The values of rrit and nih are given 
in GeV. 





Br(t ^ W+W-c)/X^ X 10*^ 


Br(t ^ ZZc)/X^ X 10*^ 




m,h = 175 


m,h = 185 


TOft = 195 


m,h = 175 


m,h = 185 


TOft = 195 


170 


4.71 X 10"- 


1.15 X 10"- 


1.93 X 10"^ 


/ 


/ 


/ 


175 


0.411 


5.71 X 10"^ 


2.22 X 10"^ 


/ 


/ 


/ 


180 


34.9 


0.202 


6.68 X 10-^ 


/ 


/ 


/ 


185 


112 


0.792 


0.167 


6.97 X lO-'^ 


9.88 X 10"^ 


2.64 X lO""* 


190 


216 


26.0 


0.398 


3.03 X 10-^ 


8.69 


2.61 X 10-^ 


195 


336 


82.4 


1.15 


0.121 


28.8 


0.313 


200 


466 


158 


20.7 


0.282 


55.9 


12.8 



Figure Captions 

Fig. 1: (a) The Standard Model diagram for e"'"e~ — > tcvgi^e] (b) Diagrams for e+e" 
tcvei)f,{e^ e~) in Model III. 

Fig. 2: The cross-section a{e^e~ — tcVf.Vf, + icUeUg) in units of as a function of ruh for 
■s/s = 0.5, 1, 1.5 and 2 TeV. a = tt/A and we have set A = 1 in the width F-^. 

Fig. 3: The cross-section a{e'^e~ — > tcUeVe + tcUeVe) in units of A^ as a function of (sina)^ for 
^/s = 1 TeV, ruh = 250 GeV and mj? = 250, 1000 GeV. A as in Fig. 2. 

Fig. 4: The ratio R""*" \= '^i^^^'^^^'^ei^e+tcu^e) ] for m// = 1 TeV, as a function of mn for 

° [ <7(e+e — ►7— ) J 

= 0.5, 1, 1.5 and 2 TeV. A and a as in Fig. 2. 

Fig. 5: The ratio R"""^" for = 1 TeV, as a function of ^/s for = 250, 350 and 450 GeV. 
A and a as in Fig. 2. See also caption to Fig. 4. 

Fig. 6: The ratio = ^^'^ ^ -^veVetc+v^v^tc) foj, _ ^ TeV, as a function of rrth for 

y/s = 0.5, 1, 1.5 and 2 TcV. A and a as in Fig. 2. 

Fig. 7: The Feynman Diagram for //' tcV in Model III. For e~^e~ — > tcZ, V = Z, f = e~ 
and /' = e+. 

Fig. 8: The cross-section a{e^e~ tcZ + tcZ) in units of A^ as a function of ruh for -s/s = 
0.5, 1, 1.5 and 2 TeV. A and a as in Fig. 2. 

Fig. 9: The cross-section cr(e+e" tcZ + tcZ) in units of A^ as a function of \/s for rrih = 
200, 250, 300, 350 and 400 GeV. A and a as in Fig. 2. 

Fig. 10: The cross-section a{e^e^ tcZ + icZ) in units of A^ as a function of (sina)^ for 
= 1 TeV, mh = 250 GeV and = 250, 1000 GeV. A as in Fig. 2. 
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Fig. 11: The scaled branching ratio, Br{t — > W~^W c)/}? as a function of m/j for various 
values oi mt. A and a as in Fig. 2. 

Fig. 12: The scaled branching ratios, Br{t W+W-c)/\^ and Br{t ZZcj/X^ as a function 
of nit for = 1 TeV and = 170 and 185 GeV. A and a as in Fig. 2. 



19 



Figure 1 




(a) 



(b) 



Figure 2 




Figure 3 



mh=250 GeV, mH=250 GeV 

111^=250 GeV, mH=l TeV 




s^'=l TeV 




/ 

/ ' ^ 
1' 

\ 

\ 

\ 


\ / 
\ / 

/ \ 


y-^ 
/ N 
/ \ ■ 
/ \ 

/ \ 


\ 

\ 

\ 

\ 

s 

s 

N 

1 . 1 ^ ^ . 


/ 

✓ 

y 

- •- 1 . 1 





1 I 1 I " ~ ■ ^ I 1 I 1 i 

0.0 0.2 0.4 0.6 0.8 1.0 



Figure 4 




Figure 5 




Figure 6 




Figure 7 




Figure 8 




Figure 9 



0.6 - 



0.4 - 



0.2 - 



111^=200 GeV 

111^=250 GeV 

111^=300 GeV 

m^=350 GeV 

111^=400 GeV 



mH=l TeV 



250 500 750 1000 1250 1500 1750 2000 

S^'^ (GeV) 



Figure 10 



111^=250 GeV, mH=l TeV 

111^=250 GeV, mH=250 GeV 




Figure 11 




Figure 12 




